Real-time Visualization of Musical Expression
نویسنده
چکیده
A system for real-time feedback of expressive music performance is presented. The feedback is provided by using a graphical interface where acoustic cues are presented in an intuitive fashion. The graphical interface presents on the computer screen a three-dimensional object with continuously changing shape, size, position, and colour. Some of the acoustic cues were associated with the shape of the object, others with its position. For instance, articulation was associated with shape, staccato corresponded to an angular shape and legato to a rounded shape. The emotional expression resulting from the combination of cues was mapped in terms of the colour of the object (e.g., sadness/blue). To determine which colours were most suitable for respective emotion, a test was run. Subjects rated how well each of 8 colours corresponds to each of 12 music performances expressing different emotions.
منابع مشابه
A Structural Analysis of Musical Gnostic Prose works with an Emphasis on their Lyrical Contents
Gnostic prose works cover a wide range of subjects, contents, styles, structures, languages, and manners of expression. They might, therefore, be all categorized under one single literary genre. Applying the general term "gnostic prose works" to these oeuvres hinders our understanding of their true nature. Despite that many gnostic prose works belong to Gnosticism, they have special characteris...
متن کاملGhostfinger: a novel platform for fully computational fingertip controllers
We present Ghostfinger, a technology for highly dynamic up/down fingertip haptics and control. The overall user experience offered by the technology can be described as that of tangibly and audibly interacting with a small hologram. More specifically, Ghostfinger implements automatic visualization of the dynamic instantiation/parametrization of algorithmic primitives that together determine the...
متن کاملFrom Music to Visuals – and Back 2D Fourier Transform applied on Music Piano Roll Plots
When a 2D Fourier Transform is applied to piano roll plots which are often used in sequencer software, the resulting 2D graphic is a novel music visualization which reveals internal musical structure. This visualization converts the set of musical notes from the notation display in the piano roll plot to a display which shows structure over time and spectrum within a set musical time period. Th...
متن کاملDesign and Test of the Real-time Text mining dashboard for Twitter
One of today's major research trends in the field of information systems is the discovery of implicit knowledge hidden in dataset that is currently being produced at high speed, large volumes and with a wide variety of formats. Data with such features is called big data. Extracting, processing, and visualizing the huge amount of data, today has become one of the concerns of data science scholar...
متن کاملVisualization Tools for Musical Timing Applied to Afro-Cuban Percussion
Timing is perhaps the most fundamental aspect of music, and visualization tools can help in formulating hypotheses and exploring questions regarding musical timing. We present a series of novel graphical representations of musical timing, generated by computer from signal analysis of audio recordings and from listeners’ annotations collected in real time. We have tested our methods on recording...
متن کاملTweetDreams: Making Music with the Audience and the World using Real-time Twitter Data
TweetDreams is an instrument and musical composition which creates real-time sonification and visualization of tweets. Tweet data containing specified search terms is retrieved from Twitter and used to build networks of associated tweets. These networks govern the creation of melodies associated with each tweet and are displayed graphically. Audience members participate in the piece by tweeting...
متن کامل